Mapping and Revising Markov Logic Networks for Transfer Learning
نویسندگان
چکیده
Transfer learning addresses the problem of how to leverage knowledge acquired in a source domain to improve the accuracy and speed of learning in a related target domain. This paper considers transfer learning with Markov logic networks (MLNs), a powerful formalism for learning in relational domains. We present a complete MLN transfer system that first autonomously maps the predicates in the source MLN to the target domain and then revises the mapped structure to further improve its accuracy. Our results in several real-world domains demonstrate that our approach successfully reduces the amount of time and training data needed to learn an accurate model of a target domain over learning from scratch.
منابع مشابه
Transfer Learning by Mapping and Revising Relational Knowledge
Transfer Learning (TL) attempts to leverage knowledge previously acquired in a source domain to improve the accuracy and speed of learning in a related target domain. Statistical Relational Learning (SRL) concerns methods that combine the strengths of predicate logic and probabilistic graphical models in order to effectively and robustly learn and reason about complex relational data. Our recen...
متن کاملPolicy Transfer via Markov Logic Networks
We propose using a statistical-relational model, the Markov Logic Network, for knowledge transfer in reinforcement learning. Our goal is to extract relational knowledge from a source task and use it to speed up learning in a related target task. We show that Markov Logic Networks are effective models for capturing both source-task Q-functions and source-task policies. We apply them via demonstr...
متن کاملDeep Transfer as Structure Learning in Markov Logic Networks
Learning the relational structure of a domain is a fundamental problem in statistical relational learning. The deep transfer algorithm of Davis and Domingos attempts to improve structure learning in Markov logic networks by harnessing the power of transfer learning, using the second-order structural regularities of a source domain to bias the structure search process in a target domain. We prop...
متن کاملTransfer in Reinforcement Learning via Markov Logic Networks
We propose the use of statistical relational learning, and in particular the formalism of Markov Logic Networks, for transfer in reinforcement learning. Our goal is to extract relational knowledge from a source task and use it to speed up learning in a related target task. We do so by learning a Markov Logic Network that describes the source-task Q-function, and then using it for decision makin...
متن کاملTransfer Learning with Markov Logic Networks
We propose a new algorithm for transfer learning of Markov Logic Network (MLN) structure. An important aspect of our approach is that it first diagnoses the provided source MLN and then focuses on re-learning only the incorrect portions. Experiments in a pair of synthetic domains demonstrate that this strategy significantly decreases the search space and speeds up learning while maintaining a l...
متن کامل